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AMENDMENTS TO THE CLAIMS 

Applicants submit below a complete listing of the current claims, including marked-up 
claims with insertions indicated by underlining and deletions indicated by strikeouts and/or 
double bracketing. This listing of claims replaces all prior versions, and listings, of claims in the 
application: 

1 . (Currently amended) An analysis system, comprising: 
a plurality of sensors configured to collect perception evidence; 
a computer system comprising a perception system that, when executed, consumes 
computing resources of the computing system, the perception system comprising: 

a control component that selectively gathers from the plurality of sensors the 
perception evidence, the perception evidence being gathered at times selected to limit 
utilization of the computing resources of the computer system by the perception system; 
and 

an analysis component that utilizes an analysis policy to analyze the perception 
evidence to determine a context of a user of the computer system, 
wherein: 

the control component uses information from the analysis component 
regarding at least one feature about which to collect data to select the times at 
which to gather perception evidence from one or more of the plurality of sensors; 

the analysis component generates the information based on a value of the 
at least one feature for determining the context; 

the analysis policy comprises at least one selected from the group consisting of: a 
random selection perception policy that randomly selects which features to utilize on a frame by 
frame basis, a rate-based perception policy that defines observational frequencies and duty cycles 
for at least one feature or an EVI-based perception policy that determines an expected value of 
information via a cost-benefit analysis means utilizing at least expected values and cost of 
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analysis values for at least one feature, the cost of analysis values comprising at lea st one value 
proportional to an impact to the computing resources employed by the perception system. 

2. (Original) The system of claim 1, the analysis component employing, at least in 
part, learned inferences relating to persistence versus volatility of observational states to account 
for unobserved data. 

3. (Original) The system of claim 2, the learned inferences based, at least in part, on 
a probability distribution over future states based on at least one previously observed value that 
is captured by at least one function of time. 

4. (Original) The system of claim 3, the probability distribution comprising a 
Gaussian distribution: 



where n is a mean value and c(t) is a standard deviation at time "t" 

5. (Original) The system of claim 1, the control component employing a criticality 
level of at least one user task to limit utilization of computing resources by the perception 
system. 

6. (Original) The system of claim 1 , the control component limiting utilization of 
computing resources based upon context. 

7. (Original) The system of claim 1, the control component limiting utilization of 
computing resources by controlling what analysis policy is employed. 
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8. (Original) The system of claim 7, the selection of the analysis policy based on 
context information. 

9. (Original) The system of claim 1, further comprising at least one perception 
sensor to provide the perception evidence for the perception system. 

10. (Original) The system of claim 9, the control component limiting utilization of 
computing resources by facilitating control of at least one selected from the group consisting of 
an analysis process for at least one perception sensor and a focus of attention of at least one 
perception sensor. 

1 1 . (Original) The system of claim 9, the control component limiting utilization of 
computing resources by controlling what perception sensors are employed. 

12. (Original) The system of claim 9, the perception sensor comprising at least one 
selected from the group consisting of a video camera, an audio microphone, a keyboard 
keystroke sensor, a mouse utilization sensor, and a motion detector. 

1 3 . (Original) The system of claim 9, the perception sensor comprising a detector for 
at least one state of at least one selected from the group consisting of at least one data structure 
within a computing system and at least one application activity within a computing system. 

14. (Original) The system of claim 1, further comprising a user interface component 
that interfaces with at least one user to relay information relating to user perception preferences 
to the perception system. 

15. (Original) The system of claim 14, the control component employing at least one 
user perception preference to limit utilization of computing resources by the perception system. 
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16. (Original) The system of claim 14, the user perception preferences comprising 
values of cost for utilizing computing resources. 

17. (Original) The system of claim 1, the perception evidence analysis operations 
comprising analysis policy selection control operations between the control component and the 
analysis component. 

18. (Original) The system of claim 1, the perception evidence analysis operations 
comprising perception evidence related information exchanges between the control component 
and the analysis component. 

19. (Original) The analysis system of claim 1 utilized to design an analysis policy of 
at least one perception system and its perception sensors. 

20. (Original) The analysis system of claim 1 utilized to determine at least one value 
of adding at least one sensor to at least one perception system. 

21 . (Original) The analysis system of claim 1 utilized to provide information relating 
to volatility of data due to influences of a flow of time. 

22. (Original) The analysis system of claim 1 utilized to determine at least one time- 
based economic value of a business given its environmental context. 

23 . (Original) The system of claim 1 , the analysis policy comprising a context-based 
analysis policy. 
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24. (Original) The system of claim 1 , the analysis policy comprising a random 
selection perception policy that randomly selects which features to utilize on a frame by frame 
basis. 

25. (Original) The system of claim 1 , the analysis policy comprising a rate-based 
perception policy that defines observational frequencies and duty cycles for at least one feature. 

26. (Original) The system of claim 25, the rate-based perception policy utilizing off- 
time that is determined by cross-validation means on a real-time data validation set to determine 
time for computations. 

27. (Original) The system of claim 1 , the analysis policy comprising an EVI-based 
perception policy that determines an expected value of information via a cost-benefit analysis 
means utilizing at least expected values and cost of analysis values for at least one feature. 

28. (Original) The system of claim 27, the cost of analysis values comprising at least 
one value proportional to an impact to the computing resources employed by the perception 
system. 

29. (Original) The system of claim 27, the EVI-based perception policy employing a 
context-based cost model to determine the cost of analysis values. 

30. (Original) The system of claim 27, the EVI-based perception policy employing 
real-time computations of expected value of information. 

3 1 . (Original) The system of claim 30, the real-time computations processed utilizing 
a myopic, single step approach for computing a next best set of observations. 
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32. (Original) The system of claim 27, the cost of analysis values comprising at least 
one selected from the group consisting of dollar values, percentage of CPU utilization values, 
latency values, and user selected preference values. 

33. (Original) The system of claim 27, the cost-benefit analysis means utilizing 
substantially similar value types for a cost value and a benefit value to calculate the expected 
value of information. 

34. (Original) The system of claim 27, the cost-benefit analysis means further 
comprising at least one utility model that facilitates in analyzing a benefit of determining a value 
of at least one feature. 

35. (Original) The system of claim 34, the utility model comprising a conditional 
utility model that alters functionality dependent upon context. 

36. (Currently amended) An analysis system comprising at least one processor , the 
analysis system comprising 



a control component that selectively gathers perception evidence to limit utilization of 
computing resources by a perception system; and 

an analysis component that utilizes an analysis policy to analyze , with the at least one 
processor, the perception evidence obtained for employment in the perception system; wherein 

the analysis component is interactive with the control component for perception evidence 
analysis operations, 

the analysis policy comprises an EVI-based perception policy that determines an 
expected value of information via a cost-benefit analysis means utilizing at least expected values 
and cost of analysis values for at least one feature, 

the cost-benefit analysis means comprise at least one utility model that facilitates in 
analyzing a benefit of determining a value of the at least one feature, 
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the utility model comprises a conditional utility model that alters functionality 
dependent upon context, and 

the expected value of information is determined, at least in part, via utilization of 
Equation (2): 



where EVI(f k ) is the expected value of information for perceptual feature combination/*, EV(f k ) is 
an expected value of/* based on observed evidence, E represents previous observational 
evidence, t/(M„ Mj) is a utility of assessing a value of asserting that real-world state M,- is Mj, and 
cost(fk) is a computational cost associated with computing feature combination/. 

37. (Original) The system of claim 27, the EVI-based perception policy further 
comprising a probabilistic model. 

38. (Original) The system of claim 37, the probabilistic model comprising a Hidden 
Markov Model (HMM) model. 

39. (Original) The system of claim 38, the expected value of information determined, 
at least in part, via Equation (4): 



EVI(f k ) = EV(f k ) - max ^(M,. | E)U(M iy M j)-cost(f k ) 



Eq. (2) 




max £ U(M i , M } ) p(Mj 




Eq. (4) 



j 



Application No. 10/729,464 9 Docket No.: Ml 103.70734US00 

Reply to Office Action of May 28, 2010 

where EVJ(f k ) is the expected value of information for perceptual feature combination/*, a " (s) 
is an alpha or forward variable at time t and state s in a standard Baum-Welch algorithm, a", is a 

transition probability of going from state s to state /, and b"(olf ) is a probability of observing 

olf in state /, all of them in model M„, C/(M„ MJ) is a utility of assessing a value of asserting 
that real-world state M, is M h and/7 ,m = \ ... M to denote all possible values of a feature 

combination/*, and cost(0^ k )isa computational cost associated with computing observations 




40. (Original) The system of claim 38, the expected value of information determined, 
at least in part, via discretized Equation (5): 

max£t/(M,.,M,)/>(M 7 ) 

' J 

- max X U (M i ,, M , )p(M . ) - cost {O^ ) Eq ' (5) 

where EVI is the expected value of information, a " (s) is an alpha or forward variable at time t 
and state 5 in a standard Baum-Welch algorithm, a", is a transition probability of going from 

state s to state /, and b" (O^* ) is a probability of observing of +x k in state /, all of them in model 
M„, U(M h Mj) is a utility of assessing a value of asserting that real-world state M t is Mj, and/7 , 
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m = 1 . . . Mto denote discretized values of a feature combination f k , and costiO,^ ) is a 

f 

computational cost associated with computing observations Of +l k . 

41 . (Original) The system of claim 37, the probabilistic model comprising a Layered 
Hidden Markov Model (LHMM) model. 

42. (Original) The system of claim 41, the Layered Hidden Markov Model (LHMM) 
utilized to substantially reduce re-training of higher level layers when an operating environment 
change occurs. 

43. (Currently amended) A method of analyzing data, comprising: 
with the at least one processor: 

obtaining perception evidence for a perception system from a plurality of sensors 
for a particular cont e xt ; 

determining a context from the perception evidence; 

analyzing the perception evidence utilizing an analysis policy to determine a 
perceived system value indicating a value of utilization of computing resources of a computer 
system by the perception system ; and 



resources of a comput e r syst e m by th e perooption syot e m by determining at least one sensor from 
the plurality of sensors wh e th e r to obtain the perception evidence bas e d on th e d e t e rmin e d 



least one sensor, wherein the time is obtain e d is selected based on an intensity of interaction of a 
user with the computer system. 

44. (Currently amended) The method of claim 43 , wherein analyzing the perception 
evidence further comprising comprises : 



employing the perceived system value to limit utilization of the computing 




wh e r e in and a time at which to obtain the perception evidence by the at 
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employing, at least in part, learned inferences relating to persistence versus volatility of 
observational states to provide unobserved perception evidence in lieu of observed perception 
evidence. 

45 . (Currently amended) The method of claim 44, wherein the learned inferences are 
based, at least in part, on a probability distribution model for future states based on at least one 
previously observed value that is captured by at least one function of time. 

46. (Currently amended) The method of claim 45, wherein the probability 
distribution model comprising comprises , at least in part, a Gaussian distribution: 



where n is a mean value and c(t) is a standard deviation at time "t" 

47. (Original) The method of claim 43, further comprising: 

accepting user input to obtain user preferences to establish criteria for limiting utilization 
of the computing resources by the perception system. 

48. (Currently amended) The method of claim 47, wherein the criteria comprising 
comprises at least one critical task that supersedes analysis of the perception evidence for the at 
least one feature in a giv e n the context. 

49. (Currently amended) The method of claim 43, further comprising: 
e mploying at loast on e perc e ption sensor to obtain the perception ovidenc e ; and 
extracting the perception evidence pertaining to at least one feature from the perc e ption at 

least one sensor. 
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50. (Cancelled) 

5 1 . (Currently amended) The method of claim 49, further comprising: 
selecting when p e rception sensors ar e employ e d the at least one sensor is employed to 

obtain the perception evidence to further optimize the limiting of the computing resources 
employed by the perception system. 

52. (Currently amended) The method of claim 49, wherein the at least one porcoption 
sensor comprising obtains perception evidence for at least one feature. 

53. (Currently amended) The method of claim 43, further comprising: 
selecting the analysis policy based on optimization of limiting the computing resources 

for [[a]] given the context. 

[[53]] 54. (Currently amended) The method of claim 43, further comprising: 
selecting the analysis policy based on optimization of limiting the computing resources 
for obtaining a desired feature. 

5 5 . (Currently amended) The method of claim 43 , wherein employing the perceived 
system value comprising comprises utilizing the computing resources when the perceived system 
value is above a threshold. 

56. (Currently amended) The method of claim 43, wherein employing the perceived 
system value comprising comprises utilizing the computing resources for a feature combination 
that yields a maximal perceived system value. 

57. (Original) The method of claim 55, the threshold is a predetermined threshold. 
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58. (Original) The method of claim 57, the predetermined threshold is set via a user 
preference. 

59. (Original) The method of claim 57, the predetermined threshold is set via the 
perception system based on context. 

60. (Original) The method of claim 43, the analysis policy comprising a rate-based 
perception policy. 

61 . (Original) The method of claim 60, further comprising: 

defining observational frequencies and duty cycles via a cross-validation means on a real- 
time data validation set for perception sensors employed by the perception system; and 

determining which perception sensors are providing sensed data and utilizing the sensed 
data to compute features facilitated by the sensed data. 

62. (Original) The method of claim 61, further comprising: 

adapting the observational frequencies and duty cycles for at least one sensor 
dynamically. 

63. (Original) The method of claim 43, the analysis policy comprising a random 
selection-based perception policy. 

64. (Original) The method of claim 63, further comprising: 

determining features available based on available perception sensors employed by the 
perception system; 

randomly selecting which features to analyze; and 

processing at least one analyzed feature to determine output perception data. 
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65. (Original) The method of claim 43, the analysis policy comprising an EVI-based 
perception policy. 

66. (Original) The method of claim 65, further comprising: 
calculating a benefit value for determining a feature; 
calculating a cost value for determining the feature; and 

utilizing the EVI-based perception policy to derive a cost-benefit analysis value of the 
feature; the cost benefit analysis utilizing a benefit value and a cost value. 

67. (Original) The method of claim 66, the benefit value and the cost value 
calculated employing a substantially similar value type. 

68. (Original) The method of claim 67, the value type comprising at least one 
selected from the group consisting of a dollar value, a percentage of CPU utilization value, a 
latency value, and a user-selected value. 

69. (Original) The method of claim 65, the EVI-based perception policy further 
comprising at least one selected from the group consisting of a utility model and a probabilistic 
model. 

70. (Original) The method of claim 69, further comprising: 

evaluating an expected value of information (EVI) utilizing, at least in part, employment 
of Equation (2): 

EVI(f k ) = EV(f k ) - max I E)U(M n M j)-cost(f k ) Eq. (2) 

' J 

where EVI(f k ) is the expected value of information for perceptual feature combination/*, EV(f k ) is 
an expected value of/* based on observed evidence, E represents previous observational 
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evidence, U(M h Mj) is a utility of assessing a value of asserting that real-world state M, is Mj, and 
cost(f0 is a computational cost associated with computing feature combination/*. 

7 1 . (Original) The method of claim 69, the probabilistic model comprising a Hidden 
Markov Model (HMM). 

72. (Original) The method of claim 71, further comprising: 

evaluating an expected value of information (EVI) utilizing, at least in part, employment 
of Equation (4): 

' j 

- max X U (M , , M , )/?(M , ) - cos? (C^, ) Eq - (4) 

where ^FJ^) is the expected value of information for perceptual feature combination/*, a " (s) 
is an alpha or forward variable at time t and state s in a standard Baum-Welch algorithm, a", is a 

transition probability of going from state s to state /, and b" {ofj ) is a probability of observing 

olf in state /, all of them in model M n , U(M h Mj) is a utility of assessing a value of asserting 
that real-world state M, is My, and/7 » m = 1 • • • MXo denote all possible values of a feature 
combination/, and cost{of +x k ) is a computational cost associated with computing observations 
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73. (Original) The method of claim 71 , further comprising: 

evaluating an expected value of information (EVI) utilizing, at least in part, employment 
of discretized Equation (5): 

max£Lr(M,.,M;)/?(M,.) 
' j 

- max X U(M i ,Mj)p(M J ) - cost (0* ) Eq> (5) 

y 

where £Wis the expected value of information, a * (s) is an alpha or forward variable at time t 
and state s in a standard Baum- Welch algorithm, a n sl is a transition probability of going from 

state s to state /, and b" (0^ k ) is a probability of observing ofc in state /, all of them in model 
M„, U(Mi, Mj) is a utility of assessing a value of asserting that real-world state M, is M j} and/7 » 

w = 1 ... M to denote discretized values of a feature combination fk, and cost{ of + { ) is a 

computational cost associated with computing observations . 

74. (Original) The method of claim 69, the probabilistic model comprising a Layered 
Hidden Markov Model (LHMM). 

75. (Original) The method of claim 74, further comprising: 

employing lower level layers of the LHMM to mask higher level layers from needing to 
be re-trained when the perception system is changed to a new environment. 

76. (Original) A perception evaluation system utilizing the method of claim 43 to 
determine benefits of additional perception sensors to a perception system. 
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77. (Original) A perception design system utilizing the method of claim 43 to design 
a perception system to optimally limit utilization of computing resources. 

78. (Original) A perception response system employing the method of claim 43 to 
provide information utilizing knowledge of volatility of data due to influences of a flow of time 
to re-determine perceptions at appropriate intervals. 

79. (Currently amended) A data analysis system, comprising: 

aonoor moans a plurality of sensors to collect a plurality of features as perception 
evidence; 

control means to limit utilization of computing resources of a computer s ystem by a 
perception system by controlling e efttrei the plurality of sensors to selectively gather the 
perception evidence obtained for o mploym e nt via [[a]] the perception system to limit utilization 
of computing r e sourc e s of a eomputor syst e m by the p e rcoption oyot e m ; and 

analyzing means toi 

analyze the perception evidence utilizing an analysis policy to determine context 
of use of the computer system by one or more users in which the perception system is operating, 
and 

whoroin tho analyzing moano io e mploy e d to guide the control means to limit the 
utilization of the computing resources regarding bv determining which features from the plurality 
of features to collect by tho aonoor means as the perception evidence depending on a value of the 
features for limiting [[of]] the utilization of the computing resources by the perception system 1 
based on the determined context; wherein 

the control means selects at least one sensor from the plurality of sensors to 
collect the features . 



80. 



(Currently amended) A data analysis system, comprising: 
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a first component of a perception system that receives a data query relating to data to 
determine a context in which the perception system is operating so that to limit utilization of 
computing resources of a computer system by the perception system, wherein the data comprises 
perception evidence pertaining to at least one feature collected by a plurality of sensors; and 
a second component that 

analyzes , with the at least one processor, volatility versus persistence of 
observations of at least one state of the data over time to establish reasonableness in timing of at 
least one reply to the query, wh e r e in and 

selects at least one sensor from the plurality of sensors tocollect the perception 
evidence pertaining to the at least one feature to limit the u tilization of the computing 
resources based on a value of the at least one feature in the context, and wherein 

selection of the at least one feature depends on an intensity of interaction of a user 
with the computer system. 

81. (Cancelled) 

82. (Currently amended) A computer readable medium having stored thereon 
computer executable components that, when executed with the at least o ne processor, implement 
the control component and the analysis component of the system of claim 1. 

83. (Original) A device employing the method of claim 43 comprising at least one 
selected from the group consisting of a computer, a server, and a handheld electronic device. 

84. (Original) A device employing the system of claim 1 comprising at least one 
selected from the group consisting of a computer, a server, and a handheld electronic device. 



